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DETAILED ACTION 



Continued Examination Under 37 CFR 1.114 



1 . A request for continued examination under 37 CFR 1 .1 14, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. 

2. Applicant's submission filed on July 29, 2002 has been entered. Claims 1 , 5, 48, 
and 50 have been amended. 



3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form 
the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in a patent granted on an application for patent by another filed in the 
United States before the invention thereof by the applicant for patent, or on an international application 
by another who has fulfilled the requirements of paragraphs (1 ) t (2), and (4) of section 371 (c) of this 
title before the invention thereof by the applicant for patent. 

4. Claims 1-3, 5-16, 19-30, 37, 39, 48, 50 are rejected under 35 U.S.C. 102(e) as 
being anticipated by Ho et al. (U.S Patent 6,021,412). (Hereinafter referred to as "Ho") 

As per claim 1, Ho teaches a method for searching a database comprising: 
• "automatically creating a query directly from the indicated object, the query 
having a data structure that is recognizable by a search engine for the database" 
at Col. 1 lines 50-63 and Fig. 8; 



Claim Rejections - 35 USC § 102 
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• "providing the query to the search engine, the search engine searching the 
database for at least one object that is related to the indicated object" at Col. 1 
lines 63-67 and Figs. 9-10; 

• "returning the result from the query of the database, the result indicating when at 
least one object is related to the indicated object" at Col.1 lines 63-67 and Fig. 
10; 

• "producing a display of a related object, so that the related object may be 
associated with the indicated object" at Col. 1 line 67 to Col. 2 line 3 and Fig. 12. 

As per claim 2, Ho also teaches: "the indicated object and the related 
object include data, the data comprising video, picture, sound, and text" at Col. 3 lines 
1-10. 

As per claim 3, Ho teaches: 

• "enabling a qualification engine to determine a context of the indicated object" at 
Col. 1 lines 50-65; 

• "employing the context of the indicated object to automatically create the query 
for the database" at Col. 1 lines 63-67. 

As per claim 5, Ho teaches "a method for obtaining an image from a 
database for insertion into a document" (Col. 1 lines 35-40) comprising: 

• "enabling an automatic creation of a query directly from the indicated text, the 
query having a data structure that is recognizable by a search engine for the 
database" at Col. 1 lines 50-63; 
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• "providing the query to the search engine, the search engine searching the 
database for an image that is related to the indicated text" at Col. 1 lines 63-67; 

• "returning the result from the query of the database, the result indicating when at 
least one image is related to the indicated text" at Col. 1 lines 63-67; 

• "enabling the display of at least one image indicated by the result from the query, 
a displayed image being selectable for insertion into the document" at Col. 1 line 
67 to Col. 2 line 5. 

• "displaying a related image that is inserted into the document, so that the related 
image is associated with the indicated text in the document" at Fig. 12. 

As per claim 6, Ho also teaches: "employing a user interface component 
to automatically create the query for the database, the creation of the query being 
related to the indicated text" at Fig. 2-4 and Figs 7-9. 

As per claim 7, Ho teaches: "the user interface component enables the 
indicated text to be edited" at Col. 3 line 63 to Col. 4 line 2. 

As per claim 8, Ho teaches: "the user interface component enables the 
indicated text to be chosen in the document" at Col. 3 lines 40-50. 

As per claim 9, Ho teaches: "choosing the indicated text in the document 
for the query of the database from within an application program that provides the 
document" at Col. 3 lines 50-55. 

As per claim 10, Ho teaches "choosing a command to create the query 
for the indicated text, the command including an indication in a context menu, drop- 
down menu, pop-up window, dialogue box, toolbar and hot key" at Fig. 4. 
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As per claim 11, Ho teaches: "choosing the indicated text in the 
document for the query of the database from an application program that is separate 
from another application program that provides the document" at Col. 4 lines 20-25. 

As per claim 12, Ho teaches: "enabling the indicated text to 
be chosen in another application program that does not provide the document, including 
a clipboard program" at Col. 4 lines 20-25. 

As per claim 13, Ho teaches: 

• "enabling a qualification engine to determine a context of the indicated text within 
the document" at Col. 1 lines 50-65. 

• "providing the context of the indicated text to the user interface component, the 
user interface component employing the context of the indicated text to 
automatically create the query for the database" at Figs. 6-9. 

As per claim 14, Ho teaches: "the determined context of the indicated 
text includes text, template, sound, video, picture, use and user preference" at Col. 9 
lines 25-30. 

As per claim 15, Ho teaches "the search engine is a local search engine, 
the local search engine employing the query to search for related images on a local 
drive that includes the database" at Col. 4 lines 3-25. 

As per claim 16, Ho teaches: " the local drive includes hard disk, floppy 
disk, tape drive, DVD and CD-ROM" at Col. 4 lines 3-10. 

As per claim 19, Ho teaches: "further comprising employing a result 
component to manage the result of the query returned by the search engine, the result 
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component enabling the parsing, storing and display of the result of the query" at Col. 3 
lines 30-35. 

As per claim 20, Ho teaches: "the result is in a metadata format" at Col. 6 

lines 15-20. 

As per claim 21, Ho teaches: "requesting at least one related image from 
the database that is indicated by the result of the query, the related image being 
provided as binary image data" at Col. 3 lines 30-35. 

As per claim 22, Ho teaches: "employing an image component for 
managing the storage and display of binary image data" at Figs. 10-11. 

As per claim 23, Ho teaches: "employing a navigation component to 
provide at least one control for displaying at least one related image" at Figs. 10-11. 

As per claim 24, Ho teaches: "a navigation component enables the 
display of a group of related images in a slide show, the group of related images being 
indicated in the result from the query" at Figs. 10-11. 

As per claim 25, Ho teaches: "the navigation component enables another 
group of related images to be displayed in the slide show, the other group of related 
images being indicated in the result from the query" at Figs. 10-1 1 . 

As per claim 26, Ho teaches: "the navigation component includes a 
control for determining a period of time that each related image is displayed in the slide 
show. 
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As per claim 27, Ho teaches: "the navigation component includes a 
control for indicating the number of the related image in the group that is currently 
displayed in the slide show" at Figs. 10-11. 

As per claim 28, Ho teaches: "the navigation component includes a 
control for indicating each group of related images that are currently displayed in the 
slide show" at Figs. 10-11. 

As per claim 29, Ho teaches: "enabling a help facility to provide an 
explanation of a chosen topic and the help facility being launched in response to an 
input" at Figs. 10-11. 

As per claim 30, Ho teaches: "the display of at least one related image 
further comprises displaying a thumbnail of the related image" at Figs. 10-1 1 

As per claim 37, Ho teaches: "each time indicated text is employed to 
create the query, automatically saving the indicated text as an entry in a history file; and 
enabling at least one of the entries in the history file to be chosen for the currently 
indicated text" at Figs. 6-9. 

As per claim 39, Ho teaches: "automatically determining a word that is 
closest to a cursor when no indicated text is provided and employing the determined 
word as indicated text" at Col. 7 lines 15-20. 

As per claim 48, Ho teaches "a system for obtaining an image from a 
database for pasting into a document" (Col. 1 lines 35-40) comprising: 
• "a client process for causing functions to be performed, including: enabling an 

automatic creation of a query directly from the indicated text, the query having a data 
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structure that is recognizable by a search engine for the database" at Col. 1 lines 50- 
67; 

• "providing the query to the search engine, the search engine searching the database 
for an image that is related to the indicated text" at Col. 1 lines 63-67; 

• "enabling a display of at least one related image indicated by the result from the 
query, the display of a related image being selectable for insertion into the 
document" at Col. 3 lines 30-35; 

• "displaying the related image that is inserted into the document, the related image 
being associated with the indicated text in the document" at Figs. 10-11; 

• "a server process for causing functions to be performed, including: returning the 
result from the query of the database, the result indicating when at least one image 
is related to the indicated text" at Col. 3 lines 25-30; 

• "enabling the search engine to locate at least one image in the database that is 
related to the indicated text" at Col. 3 lines 25-30. 

As per claim 50, Ho teaches "a computer readable medium having 
computer-executable components" comprising: 

• "a component for automatically creating a query directly from indicated text, the 
query having a data structure that is recognizable by a search engine for a 
database" at Col. 1 lines 50-67; 

• "a component for providing the query to the search engine, the search engine 
searching the database for an image that is related to the indicated text" at Col. 1 
lines 63-67; 



Application/Control Number: 09/376,748 
Art Unit: 2177 



Page 9 



• "a component for returning the result from the query of the database, the result 
indicating when at least one image is related to the indicated text" at Col. 1 lines 63- 
67; 

• "a component for enabling the display of at least one related image indicated by the 
result from the query, the display of the related image being selectable for insertion 
into the document" at Col. 3 lines 30-35; 

• "a component for displaying the related image that is inserted into the document, so 
that the related image is associated with the indicated text in the document" at Fig. 
12. 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6. Claims 4, 18, 31-36, 38, 40-47, 49, 51-53 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Ho (U.S Patent 6,021,412) as applied to claims above, and in 
view of Balogh et al. (U.S Patent 5,493,677). 

As per claim 4, Ho teaches the same as stated in claim 1 argument. Ho does 
not teach "indicating the related object is to be purchased over a network; and providing 
financial information to an electronic commerce service over the network, the electronic 
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commerce service enabling the purchase of the related object when the financial 
information is complete". 

However, Balogh teaches the steps of: "indicating the related object is to be 
purchased over a network; and providing financial information to an electronic 
commerce service over the network, the electronic commerce service enabling the 
purchase of the related object when the financial information is complete" at Col. 17 
lines 25-65. Thus, it would have been obvious to one ordinarily skilled in the art at the 
time of the invention to combine Ho's database searching method with Balogh's 
purchasing step so that "the user may order and obtain delivery of selected images 
directly over a computer connection" (Balogh, Col. 2 lines 5-7). 

As per claim 18, Ho teaches the same as stated in claim 5 argument. Balogh's 
teaches the step of "employing a network component to communicate with the search 
engine over a network, the network including an intranet and the Internet" at Fig. 1 1 . 

As per claim 31, Ho teaches the same as stated in claim 5 arguments. Balogh's 
teaches the step of "including a digital watermark with the related image, the digital 
watermark including information related to the content of the related image" at Fig. 5. 

As per claim 32, Ho teaches the same as stated in claim 5 arguments. Balogh 
teaches: "including a cookie with the query, the cookie including information related to a 
user at Col. 9 lines 15-35. 

As per claim 33, Ho teaches the same as stated in claim 5 argument. Ho also 
teaches the step of "inserting a higher quality image into the document so that the 
higher quality image is displayed with the indicated text" at Fig. 12. Balogh teaches the 
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step of "indicating a higher quality image of the related image is to be purchased over a 
network; and providing financial information to an electronic commerce service over the 
network, the electronic commerce service enabling the purchase of the higher quality 
image when the financial information is complete" at Col. 17 lines 25-65. 

As per claim 34, Ho teaches the same as stated in claim 5 argument. Balogh 
teaches "employing an electronic shopping cart to store a potential purchase of the 
higher quality image" at Col. 17 lines 25-40. 

As per claim 35. Ho teaches the same as stated in claim 5 argument. Balogh 
teaches: "enabling a parameter of the higher quality image to be indicated" at Col. 17 
lines 28-38. 

As per claim 36, Ho teaches the same as stated in claim 5 argument. Balogh 
teaches: "enabling a use of the higher quality image to be indicated" at Col. 17 lines 50- 
55. 

As per claim 38, Ho teaches the same as stated in claim 5 argument. Balogh 
teaches: "embedding a URL with the related image pasted into the document, the URL 
providing a link to information associated with the related image" at Col. 17 lines 2-12. 

As per claim 40, Ho teaches the same as stated in claim 1 8 argument. Balogh 
teaches: " the network component employs a transmission device to automatically 
connect to the search engine for the database, the transmission device including cable 
modem, network interface card, telephony modem, satellite dish and radio transceiver" 
at Col. 16 lines 20-40. 
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As per claim 41, Ho teaches the same as stated in claim 18 argument. Balogh 
teaches the step of "employing the network component to automatically connect to the 
search engine for the database when the search engine is remotely located from the 
indicated text" at Col. 16 lines 20-40. 

As per claim 42, Ho teaches the same as stated in claim 18 argument. Balogh 
teaches: "the network component employs a proxy server to automatically connect to 
the search engine for the database" at Fig. 11. 

As per claim 43, Ho teaches the same as stated in claim 18 argument. Balogh 
teaches: "the network component employs a dial up facility to automatically connect to 
the search engine for the database" at Col. 16 lines 25-40. 

As per claim 44, Ho teaches the same as stated in claim 18 argument. Balogh 
teaches: "the network component launches a browser to automatically connect to the 
search engine for the database" at Col. 16 lines 40-50. 

As per claim 45, Ho teaches the same as stated in claim 18 argument. Balogh 
teaches: "the network component automatically connects to the search engine" at Col. 
16 lines 20-40. 

As per claim 46, Ho teaches the same as stated in claim 18 argument. Balogh 
teaches: "the network component launches a browser to manage a purchase of a higher 
quality image associated with the related images" at Col. 17 lines 39-65. 

As per claim 47, Ho teaches the same as stated in claim 18 argument. Balogh 
teaches: "the network component manages a purchase of a higher quality image 
associated with the related image" at Col. 17 lines 39-65. 
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As per claim 49, Ho teaches the same as stated in claim 48 arguments. Ho also 
teaches the step of "inserting the higher quality image into the document so that the 
higher quality images is displayed with the indicated text" at Fig. 12. 

Ho does not teach "indicating a higher quality image of the related image is to be 
purchased over a network; and providing financial information to an electronic 
commerce service over the network, the electronic commerce service enabling the 
purchase of the higher quality image when the financial information is complete". 

However, Balogh teaches the steps of: "indicating a higher quality image of the 
related image is to be purchased over a network; and providing financial information to 
an electronic commerce service over the network, the electronic commerce service 
enabling the purchase of the higher quality image when the financial information is 
complete" at Col. 17 lines 25-65. 

Thus, it would have been obvious to one ordinarily skilled in the art at the time of 
the invention to combine Ho's image database searching method with Balogh's 
purchasing step so that "the user may order and obtain delivery of selected images 
directly over a computer connection" (Balogh, Col. 2 lines 5-7). 

As per claim 51, Ho teaches a method for searching an image database 

comprising: 

• "automatically creating a query related to an indicated object, the query having a 
data structure that is recognizable by a search engine for the database" at Col. 1 
lines 50-63; 
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• "providing the query to the search engine, the search engine searching the 
database for at least one image that is related to the indicated object" at Col. 1 
lines 63-67; 

• "returning the result from the query of the database, the result indicating when at 
least one image is related to the indicated object" at Col. 1 lines 63-67; 

• "enabling a display of the related image, so that the related image may be 
associated with the indicated object" at Col. 1 line 67 to Col. 2 line 3. 

Ho does not teach the step of: "indicating a related image is to be 
purchased over the network, financial information being provided to an electronic 
commerce service that enables the purchase of the related image when the financial 
information is complete". 

However, Balogh teaches the steps of: "indicating the related image is to 
be purchased over a network; and providing financial information to an electronic 
commerce service that enables the purchase of the related image when the financial 
information is complete" at Col. 17 lines 25-65. Thus, it would have been obvious to one 
ordinarily skilled in the art at the time of the invention to combine Ho's database 
searching method with Balogh's purchasing step so that "the user may order and obtain 
delivery of selected images directly over a computer connection" (Balogh, Col. 2 lines 5- 
7). 

As per claim 52, Ho also teaches: "the indicated object includes data, 
comprising video, picture, sound, and text" at Col. 9 lines 25-30. 

As per claim 53, Ho also teaches the following steps: 
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• "enabling a qualification engine to determine a context of the indicated object" at 
Col. 1 lines 50-65; and 

• "employing the context of the indicated object to automatically create the query 
for the database" at Col. 1 lines 63-67. 

7, Claim 17 is rejected under 35 U.S.C. 103(a) as being unpatentable over Ho 
(U.S Patent 6,021,412) as applied to claim 5 above, and in view of Baru et al ("XML 
Based information Mediation for Digital Libraries.") 

As per claim 17, Ho teaches the same as stated in claim 5 argument. Ho does 
not teach "the query's data structure include XML". However, Baru teaches: "the query's 
data structure include XML" at page 214, Col. 1. Thus, it would have been obvious to 
one ordinarily skilled in the art at the time of the invention to implement Ho's invention 
using XML in order to provide a user-friendly query formulation and optimization. 

Response to Arguments 

8. Applicant's arguments filed July 29, 2002 have been fully considered but they are 
not persuasive. Examiner respectfully traverses applicant's arguments. 

Applicant stated that Ho (U.S 6,021 ,412) does not teach: "automatically creating 
a query directly from the indicated object". On the contrary, in Figure 8, Ho discloses the 
step of prompting user to select a word which appear in the document ("leadership" or 
"surprise"), after user select the word "leadership" (i.e., "indicated object") and click the 
"View Clip Art" button (Fig. 9), the result of the query using keyword "leadership" is 
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shown in Fig. 10. Therefore, Figs. 8-10 of Ho's reference correspond to steps (a) - (c) of 
claims 1, 5. 

In response to applicants argument that there is no suggestion to combine the 
references, the examiner recognizes that obviousness can only be established by 
combining or modifying the teachings of the prior art to produce the claimed invention 
where there is some teaching, suggestion, or motivation to do so found either in the 
references themselves or in the knowledge generally available to one of ordinary skill in 
the art. See In re Fine, 837 F.2d 1071, 5 USPQ2d 1596 (Fed. Cir. 1988) and In re 
Jones, 958 F.2d 347, 21 USPQ2d 1941 (Fed. Cir. 1992). In this case, the difference 
between Ho and the invention of claims 4, 51 is seen to be Ho does not disclose the 
step of allowing users to purchase images over the network as claimed. However, 
buying and selling digital objects over the network are well known in the art, as 
exemplified by Balogh. As notes by Balogh, it is desirable that "the user may order and 
obtain delivery of selected images directly over a computer connection" (Col. 2 lines 5- 
7). Consider this, it would have been obvious to those of ordinary skill in the art at the 
time of the invention to modify Ho's reference to add the purchasing step as claimed, 
financial gain is of course an obvious reasonable expectation of success. 

Similarity, the difference between Ho and the invention of claim 17 is seen to be 
Ho does not explicitly teach implement query data structure using XML. However, the 
use of XML query language is well known in the art, as exemplified by Baru. As notes 
by Baru, it is desirable to employ XML query language "to facilitate user-friendly query 
formulation, and for optimization purposes" (Col. 1, page 214). Thus, it would have been 
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obvious to those of ordinary skill in the art at the time of invention to implement Ho's 
method using XML Query Data Structure in order to provide a user-friendly query 
formulation and optimization. 

In light of the foregoing. arguments, the 35 U.S.C 102 and 103 rejections are 
hereby sustained. 

Conclusion 

9. The prior art made of record, listed on form PTO-892, and not relied upon, if any, 
is considered pertinent to applicant's disclosure. 

If a reference indicated as being mailed on PTO-FORM 892 has not been 
enclosed in this action, please contact Macia Fletcher whose telephone number is (703) 
305-4903 for faster service. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Khanh B. Pham whose telephone number is (703) 308- 
7299. The examiner can normally be reached on Monday through Friday 7:30am to 
4:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John E Breene can be reached on (703) 305-9790. The fax phone numbers 
for the organization where this application or proceeding is assigned are (703) 746-7239 
for regular communications and (703) 746-7238 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the receptionist whose telephone number is (703)746- 
7240. 
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